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Abstract. - We introduce a simple lattice model of traffic flow in a city where drivers optimize 
their route-selection in time in order to avoid traffic jams, and study its phase structure as a 
function of the density of vehicles and of the drivers' behavioral parameters via numerical 
simulations and mean-field analytical arguments. We identify a phase transition between a 
low- and a high-density regime. In the latter, inductive drivers may surprisingly behave worse 
than randomly selecting drivers. 

After the seminal works [1-3], models of vehicular traffic have enjoyed a continuously 
increasing interest among physicists (see e.g. [4-6]), and substantial progress has been achieved 
in understanding the origin of many empirically observed features. In several cases, traffic 
models have also revealed connections to important out-of-equilibrium systems in statistical 
mechanics. The NaSch cellular automaton [2,7], for instance, is a close relative of the totally 
asymmetric simple exclusion process (TASEP) [8], and of the KPZ-class of surface growth 
models [9,10]. Urban traffic has also been extensively studied. Examples are BML models 
[1,5], where vehicles are bound to travel on a lattice, representing the network of streets, with 
time-evolution governed by TASEP-like rules. Typically, increasing the density of vehicles, a 
sharp transition occurs from an unjammed regime with finite average velocity to a jammed 
state where cars are blocked in a single large cluster spanning the entire lattice. 

In these cellular-automaton type of models, the dynamics of drivers does not pursue an 
explicit goal, like minimizing traveling times. Here we introduce a different class of models. We 
postulate that each driver has a finite set of feasible routes for going between two points in a 
city and that, on each day, he/she tries to choose the least crowded one using a simple learning 
process [11]. Our principal aim is to investigate whether - and in which traffic conditions - 
inductive drivers behave more efficiently than drivers who choose their routes at random. 
A similar question arises in the Minority Game (MG) [12], and this affinity constitutes the 
starting point of our analysis. More precisely, upon increasing the density of vehicles we find 
a transition from a phase where drivers are unevenly distributed over streets to one where 
streets are equally loaded. In this latter phase, depending on their learning rates, inductive 
drivers can behave worse than randomly selecting drivers because of crowd effects. 

We consider, as a model of a city, a square lattice with L x L nodes and P = 2L 2 edges 
(assuming periodic boundary conditions). Edges represent the different streets. On each 
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Fig. 1 - Two routes of length i — 16 for going from 4 to B in a 11 x 11 city. 



day, each one of N drivers must travel from a node A (say, his/her workplace) to a node B 
(say, home) (A and B are different for different drivers) following one of S possible routes. 
Routes are sets of consecutive edges on the lattice (see Fig. Indexing edges by fi, it is 
natural to identify a route with a vector q ig = {q^}^ = i, where i = l,...,N labels drivers and 
g = 1, . . . , S labels the feasible paths of each driver, while qf g is the number of times driver i 
passes via street fj, in route g. For each i, S randomly generated routes of equal length £ (length 
= number of edges) joining two randomly chosen nodes A and B are given( 1 ). Denoting by 
5i(n) the route selected by driver i on day n, we assume that 

Prob{&(n) = g} = C e ru ^ (1) 

with C a normalization constant and T > the 'learning rate' of drivers. The functions Ui g 
are the scores of the different feasible routes of driver i, and are updated according to 

1 P 1 

U ig (n+1) = U ig (n) QtgQ^n) + -(1 - ^, 5i( n))Ci», (2) 

n=i 

where Q^(n) — Yl%=i ligdn) 1S tne num ber of drivers passing through \i on day n. We assume 
this to be known to every driver, e.g. via the GPS technology or the traffic bulletin, to a 
degree specified by the last term on the r.h.s. of J2J), which accounts for the fact that the 
driver's knowledge of the Q^(n) of routes he/she has not visited on day n (i.e. streets such 
that (£~g.t n \ = 0) is subject to the noise Qg{n), with mean value and correlations given by 

(Cig( n )) = V (Cig( n )C]h(m)) = A6ij6g h S nm (3) 

If rj = 0, the driver has unbiased information about routes he/she does not follow, whereas 
if 77 > (resp. r\ < 0) he/she overestimates (resp. underestimates) the performance of such 
routes. We shall first consider the simpler case -q = A = 0, and later discuss the effects 
introduced by i] ^ and A > 0. 

Altogether, (|TJ and J2J imply that drivers prefer less crowded routes. If one assumes that 
the transit time through street /i is proportional to , then the above dynamics describes a 
driver trying to learn which of his feasible routes is faster. For T — > oo, drivers always choose 



( )In our simulations, loops are admitted, but all results remain valid for more realistic loop-less routes. 
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Fig. 2 - Stationary values of a 2 /N and H/N as a function of c = N/P for randomly selecting drivers 
(r = 0, open markers) and adaptive drivers (r = +00, filled markers). In these simulations: S = 2, 
P = 200, £ = 50 and averages are taken over at least 50 disorder samples for each point. The initial 
conditions of J5j were taken to be Ui g (0) = for all i and g. The solid line in the graphs is the 
analytic estimate of H and a 2 (for T — + ) for the model with uncorrelated disorder. 



the route with the highest score, whereas for r < 00 they randomize the choice. In particular, 
for r = they select one of their feasible routes at random with equal probability. 

As in the MG [13], we expect the collective performance in the stationary state of © to 
depend only on the density of vehicles c = N/P — N/(2L 2 ). We focus on the asymptotic 
(long-time) values of the observables [14] 

H = (Q^f - Wf and a 2 = {{Q»f) ~Wf (4) 

where (•) stands for a time average over the stationary state of (0 and = (1/P) ^Li 
H describes the distribution of drivers over the street network in the stationary state. If 
H = 0, the distribution is uniform = for all //) and it is not possible to find 

convenient routes. If H > 0, instead, the distribution is not uniform and fast pathways do 
exist. The optimal road usage is achieved when H = and traffic fluctuations (namely a 1 — H) 
are minimized. Notice that if transit times are assumed to be proportional to the street loads 
Q^, then a 2 measures the total traveling time of drivers. Notice also that, since all routes 
have the same total length I (i.e. q!/ g = £ for all i and g), (Q^) = c£ is just a constant. 
In Fig. 12 we report the results obtained from computer experiments with r/ = A = as 
a function of c for drivers with T = 00 and T = 0. The latter lead to a stationary state 
where a uniform distribution of vehicles is never achieved, as for them H > for all c. The 
former, instead, behave in a similar way only for small c. As c is increased, the traffic load 
becomes more and more uniform (H decreases) and fluctuations (a 2 ) decrease, indicating that 
inductive drivers manage to behave better than random ones. At a critical point c c ~ 3 the 
distribution becomes uniform (i.e. H = 0) and vehicles fill the available streets uniformly. 
Now drivers can't find a convenient way and are forced to change route very frequently. As 
a consequence, global fluctuations increase dramatically. Notice that above the critical point 
traffic fluctuations are significantly smaller for randomly selecting drivers than for optimizers. 
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This behavior is very similar to that of the MG. It is easy to check, along the lines of [15], 
that in the stationary state drivers choose routes with frequencies fi g = (Prob{<7i(n) = g}) 
that minimize the 'Hamiltonian' 

H v ({f i>g })=Wf + ~Y,f^ 1 -^M> V X f ■■>''■; ( 5 ) 

subject to J2 g fig = !• I 11 fact, taking the average of @ in the stationary state, one sees that 
the stationarity conditions for fi g are exactly the conditions for the minima of TL n . Note that, 
up to a constant, TLo = H. The stationary frequencies fi g turn out to be independent of T for 
r > (see [15] for details) and of A. In turn, because of (J5J), H has the same property. 

A direct application of the standard replica-based minimization tools to compute min H 
is made difficult by the presence of spatial correlations ( 2 ) in the disorder variables q^ g . In 
order to test the effects of spatial correlations, we considered a 'naive' version of J2J), in which 
the qf g s are i.i.d. quenched random variables with the same probability distribution as in the 
lattice setup. The minima of H for this simplified model can be easily studied with the replica 
method (we do not report this analysis here) . It turns out (see Fig. |2J) that the shape of the 
functions H and a 2 (for small but non-zero T, i.e. r — + , see below) are qualitatively the 
same as those of numerical simulations at V = oo. The critical point c c = 2.9638 . . . computed 
analytically is very close to that found in numerical simulations. 

The knowledge of fi g , however, does not allow us in principle to compute er 2 , which 
requires a fully dynamical approach. Following [15], we shall now derive the continuous-time 
(stochastic) differential version of ©. To begin with, we restrict ourselves to the case 5 = 2 
(g = 1, 2) and introduce the variables yi{n) = [Un(n) — Ui2(n)]/2 and Si(n) — 3 — 2?ji(n), such 
that Si(n) = ±1 is an Ising spin. The dynamics can then be re-cast in the form 

i p i 

yi (n + 1) = yi (n) - - £ Q"(n) + - [(1 - - (1 + *(n))Ca(n)] (6) 

where = (q^ — q^ 2 )/2. Simulations show that relaxation and correlation times are propor- 
tional to 1/F. Following [15], we introduce the re-scaled time t = Tn and study the dynamics 
in a time interval At corresponding to An = At/T time steps. When T 1, we can take An 
large while keeping At small. A large An will allow us to use the central limit, while with a 
small At we can resort to a continuous-time approximation. At odds with the on-line MG, 
where characteristic times are 0(N) and this procedure is well defined as long asTcJV [15], 
in the present 'batch' version this analysis is in principle correct only for T <g; 1. However, it 
provides useful insights whose validity for r> 1 can be checked against numerical simulations. 

Introducing the new variable yi(t) = Ty^n) for t = nT and iterating © from time n to 
time n + An we obtain 




If An is large enough, by the central limit theorem, we can approximate the sum using the 
first two moments, whereas if At is small enough, the change in yi(t) is small, which means 
that yi(t) can be considered constant. The averages over the fast spin variables can then be 



( 2 )If a route goes through street fi (q^ g > 0) then nearby streets are more likely to belong to the same path 
than streets which are far away. 
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Fig. 3 - Behavior of a 2 IN for a city of P = 200 streets with N = 1024 drivers as a function of the 
parameter A with r/ — 0. The horizontal lines correspond to drivers with T — (dashed) and F = + 
(dotted). Results for adaptive drivers with F = oo are shown for equilibration times t cq = 100 (full 
line), 400 (open circles) and 1600 (full diamonds). In the inset, data are plotted versus Atl^. 



performed with the "instantaneous" distribution 

Prob{ Sl (n) = ±1} - [1 + e =FfoW]-i (8) 

which depends on the "slow" variables yi(t). After simple calculations we arrive, in the limit 
At — > 0, at the continuous-time Langevin equation 

N 

dtVi{t) = — ^ Jij tanhj/j - - tanhy, + e,(t) (9) 
j'=i 

W TA 
(ei(t)ej(0) = JifcJ ifc [l - (tanhfo) 2 ]<^ - i') + — <^£(t - t') (10) 

fe=i 

where Jjy = The case T = turns out to differ from the case T = + because the limits 

t — > oo and r — > don't commute. 

Let us first consider the case r\ — 0. For T = + , when this equation is exact, the dynamics 
becomes deterministic and the values of yi (and hence of a 2 ) can be obtained by minimizing 
the function H v given in (J5J . We were unable to compute the stationary state of © for T > 
because, as in the case of the on-line MG for H > 0, the Fokker-Planck equation associated to 
it has no simple factorized solutions (see [15]). Hence a 1 depends on T and on A for all values 
of c. Such a dependence is weak for c < c c but it becomes very strong in the high density 
phase. In particular, a 2 increases with T, as in the MG. 

When A = 0, the stationary state depends on the initial conditions j/i(0) for c > c c : the 
larger the initial spread, the smaller the value of a 2 (see [15] for the analogous phenomenon 
in the MG). For A > 0, the dependence on initial conditions disappears and is replaced by a 
non-trivial dynamical behavior (see Fig. EJ). In the high density phase, where drivers would 
behave worse than random with A = 0, global efficiency can improve beyond the random 
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threshold if A > 0. Taking averages after a fixed equilibration time i eq , we find that a 2 
reaches, for A w 40, a minimum that is well below the value of a 2 for Y = + with the same 
homogeneous initial conditions j/i(0) = 0. For A — > oo we recover the behavior of random 
drivers. However, when we increase t cq , the curve shifts to the left, showing that the system is 
not in a steady state. Rescaling A by t cq 1 , the decreasing part of the plot collapses, while the 
the rest of the curve flattens. This suggests that the equilibrium value of a 2 drops suddenly 
as soon as A > 0. In order to understand this behavior, it is useful to remind that large values 
of a 2 are due to the off-diagonal nature of the noise covariance (|10f) , which is responsible for a 
dynamic feedback effect, as shown in [16]. The presence of the diagonal noise term A destroys 
the correlated fluctuations created by the first term of (JTDJ, and removes the dependence on 
initial conditions thereby allowing a slow diffusive dynamics toward the states of maximal 
spread in the yi variables (i.e. with minimal a 2 ) which are consistent with the stationary 
state condition H = 0. In loose words: noise-corrupted information can avoid crowd effects 
when the vehicle density is very high( 3 ). 

We finally come to the case ij ^ 0. If rj > drivers overestimate the profitability of 
routes they do not take. This changes the phase transition into a smooth crossover, but the 
qualitative picture remains the same. For ij < instead the situation changes radically. This 
effect has been studied in detail in the MG [14,17,18]. Based on these results, we argue 
that while the stationary state is unique for c < c c {rf), many stationary states exist in the 
high density phase, each of which may be selected by the dynamics, depending on initial 
conditions. This feature, which corresponds to the occurrence of replica-symmetry breaking 
in the minimization of JSJ , means dynamically that the system acquires long term memory, as 
found in [18] for the 'naive' model with uncorrelated disorder and A = 0. As r\ — ► 0~ we find 
c c (rj) — > c c , while for r\ — > —2 we find c c (r\) — > 0. i] < implies that drivers overestimate the 
traffic on routes they do not take. This means that they know that if they had actually taken 
one of those route, the traffic there would have been slowed down. At the value r\ = —2, drivers 
correctly account for this fact and indeed the dynamics converges to an optimal solution, i.e. 
to a Nash equilibrium in game theoretic terminology ( 4 ). The stationary state is characterized 
by no traffic fluctuations (a 2 = H) because each driver selects one route and sticks to it. The 
value of <7 2 for -q = —2 is shown in Fig. 0] as s function of c. 

In summary, we have introduced a highly simplified model for the behavior of drivers in 
a city, with the aim of analyzing the emergent collective behavior. The model is formally 
related to the 'batch' MG [19], but displays features that are substantially different from all 
previously studied variations. In absence of information noise, inductive drivers turn out to 
behave better than random drivers for low car densities, while at high densities the opposite 
occurs. However, when A > and/or r\ < inductive drivers can be guided to a more efficient 
state, though the dynamics becomes substantially more complex. Clearly, within its skinny 
definition, we are unable to obtain a level of description as detailed as previous approaches 
to urban traffic [5,20]. However this model highlights the relevance of the inductive behavior 
of drivers as opposed to zcro-intclligcncc random drivers, and hence the impact that new 
technologies of information broadcasting can have on urban traffic. Furthermore, the model 
is amenable to be made more realistic (e.g. by considering routes with different €). This 
approach to urban traffic can draw from the rich literature on the MG and its variations, 
whose collective behavior has been clarified in detail, as well as contribute to it. 

* * * 



( 3 ) We stress, however, that the noise Q g has to be uncorrelated across agents. 

( 4 ) A Nash equilibrium here means that each driver takes the best route available to him, given the choices of 
all other drivers. 
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Fig. 4 - Behavior of a 2 /N for a city of P — 200 streets with 77 — —2. Adaptive (resp. random) 
drivers have F = 00 (resp. T = 0). 



Work supported in part by the European Community's Human Potential Programme under 
contract HPRN-CT-2002-00319, STIPCO, and by the EU EXYSTENCE network. We thank 
G. Weisbuch and I. Perez Castillo for useful discussions. The Abdus Salam ICTP is gratefully 
acknowledged for hospitality and support. 

REFERENCES 

[I] O. Biham, A. Middleton and D. Levine, Phys. Rev. A, 46 (1992) R6124. 
[2] K. Nagel and M. Schreckenberg, J. Phys. I (France), 2 (1992) 2221. 

[3] B.S. Kerner and P. Kornhauser, Phys. Rev. E, 48 (1993) R2335. 

[4] D. Helbing, Verkehrsdynamik (Springer, Berlin) 1997 (in German). 

[5] D. Chowdhury, L. Santen and A. Schadschneider, Phys. Rep., 329 (2000) 199. 

[6] D. Helbing, Rev. Mod. Phys., 73 (2001) 1067. 

[7] A. Schadschneider and M. Schreckenberg, J. Phys. A, 26 (1993) L697. 
[8] B. Derrida, Phys. Rep., 301 (1998) 65. 

[9] M. Kardar, G. Parisi and Y.-C. Zhang, Phys. Rev. Lett, 56 (1986) 889. 
[10] T. Halpin-Healy, Phys. Rep., 254 (1995) 215. 

[II] D. Helbing, Dynamic decision behavior and optimal guidance through information services: 
Models and experiments. Preprint (2002, to appear). 

[12] D. Challet and Y.-C. Zhang, Physica A, 246 (1997) 407. See also 
http://www.unifr.ch/econophysics/minority/ for an extensive and commented list of refer- 
ences. 

[13] R. Savit, R. Manuca and R. RlOLO, Phys. Rev. Lett., 82 (1999) 2203. 

[14] D. Challet, M. Marsili and R. Zecchina, Phys. Rev. Lett, 84 (2000) 1824. 

[15] M. Marsili and D. Challet, Phys. Rev. E , 64 (2001) 056138 

[16] D. Challet and M. Marsili, e-print cond-mat/02 10549 

[17] A. De Martino and M. Marsili, J. Phys. A, 34 (2002) 2525 

[18] J.A.F. Heimel and A. De Martino, J. Phys. A, 34 (2001) L539 

[19] J.A.F. Heimel and A.C.C. Coolen, Phys. Rev. E, 63 (2001) 056121 

[20] D. Chowdhury and A. Schadschneider, Phys. Rev. E, 59 (1999) R1311 



